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ABSTRACT. Image i ntens 1 t i c-S been processed trad \ t Iona \ ly without 

much regard to how they arise. Typically they are used only to segment 
an Image into region* Or to fEnd edge-fragments. Image Intensities do 
carry a great d«l of useful Mformatton about three-dimensional aspects 
of objects^ and some initial attempts are made here to- exploit this. An 
understanding of how images are formed and what determines the amount of 
Sight reflected from a point on an Object to the viewer Ts vital to such 
o development. The gradient-space, popularized by Huffman and Hackworth 
is a helpful tool in this regard. 
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Am NCty for SOhiETK | HG COMPLETELY I 3 IFf£ RE;1T 


A case will be made for the usefulness of image intensities or gray 
levels. Usually one wQuld like lo forget about image Intensities as soon 
as possible,, extracting Only edge-fragmentS or regions hefore going on, 
Kuch of the work in image analysis has used Image intensities Only to seg¬ 
ment the image, based on differences in average image intensity or sane 
higher-order measure, A great deal of Information Is contained in the 
image Intensities, however, and there are way£ of exploiting this fact. 

Our approach is based on the belief that it is important to understand the 
image-forming process if one Is to construct models of the world being 
imaged. It Is not Sufficient to try an assortment of Statistical, compu¬ 
tational, or signal-processing tricks that come out of a bag af procedures 
that has proved useful in some other domain. 

Using an understanding of the visual effects of edge imperfect! □ns and 
mutual illumination, me will be able to Suggest Enterpretations of lines 
based on image Intensity profiles across edges. A "sharp peak" or 
edge-effect will imply that the edge Is convex, a "roof" or triangufar 
profile wilt suggest a concave edge, while a Step-transition or discon¬ 
tinuity accompanied by neither a sharp peak nor a roof component will irost 
Hkely be an obscuring edge. This latter hypothesis is strengthened sig¬ 
nificantly if an "Inverse peak" or negative edge-effect is also seen, 

Hcxt we will show that the image intensities of regions meeting at a joint 
corresponding to an object corner allow one to determine fairly accurately 
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the orientation of ■each of the planes meeting at the earner. The three- 
dFiren& i onat structure of a polyhedral scene can thus bo established with¬ 
out the use of size- or sup-port "hypotheses or a Finite catalogue of models- 

Finally we wi11 turn to curved objects and show that their shape can be 
determined from the intensities recorded in the image* The approach to 
this problem presented here is supported by geometric arguments and does 
not depend on methods for solving first-order nOn-llneaf partial different" 
ial equations. It is instead a synthesis of the previous shape*from-shading 
method and the gradient-space approach, {4*2]. 

The results presented here depend to a large degree on geometric rnsT-ght 
gained by using the gradient-space approach popularized by Huffman and 
Ra c kwort h. 11,2*3,3]. Approaching the image analysts prob ten in the way 

proposed 3n this paper leads to the ability to prove or disprove that cer¬ 
tain features can be extracted from images-. It is nut claimed, however, 
that St makes any inroads on the Scene analysis problem-- 
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DEVELQPFWG THE TOOLS 


iHAGE FORMATION: 


Our iiso a I visual wtsrPd consists of opaque bodies immersed In a transparent 
TTied I uni . Since we cannot see into opaque objects , the I f Surfaces are | im¬ 
portant for recognition and description purposes. This special nature of 
our visual world mokes It reasonable to attempt to derive a node! of what 
is being seen from an image, The dimensionalities of the two domains match 
On the one hand, we have tWO-d 3 Pie ns ion a1 surfaces plus depth. On the other, 
two image dimensions plus intensity, 

Jf wc are to exploit this observation wc have to understand how images are 
formed, There are two parts to this problem. One cleats with the two Image 
dimensions and relates then to the surface coordinates, and the other deals 
With the determination of what intensity wiM be recorded In the image at 
each point. 

PROJECTION; 

First, let us look at the geometry of projection. For this purpose one 
can replace a lens with a pin-hole at Its center. Straight lines then com 

nett points on the objects to their Images -- these 1 Toes pdss through the 
pin-hole, Pf we let £x,y*z} be the coordinates of some point before the 
viewer, and: (x' T y'} Its Fmage coordinates, then 

*' - (x/z)f and y f - (y/zj f 
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Here f is the se pa rati an of the i mage plane from the lens, It is conven i - 
ent to superimpose the image plane onto the object space as fallows: 



Above Is the wel1-known perspective projection. Sometimes it is COn~ 
venSent to consider a simpler case where objects are very far away reU- 
tlve to their size. We can Imagine looking at them- through a telephoto 
lens. The scene then will occupy a small visual angle and the distance to 
points on the object will be almost constant In the projection equation. 

x 1 = * nd y' = (^/z 0 )y 


This corresponds to orthographic projection. 
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SURFACE ORIENTATION 


r s 


we 


In order to determine the light flu* reflected In the direction of the 
viewer from a particular surface element of the object, we will have to 
understand the 1 Ipht-source t object-surface, viewer geometry, in particu¬ 
lar, the surface orientation will p) ay a maj or ro]ej 

There are varies u ,„ 5 of specifying the surface orientation for a plane. 

tan. for example, give the equation defining the plane, or the direction 
of a ueetor perpend Teulor to the surface. If an equation For the plane 
an * by + cz = d, then a Suitable surface norma! is (a.b.cj. In Fact 
car, rewrite the equation (*,y,*J ■ (a,b,c) - d. T 0 show that any line 

in th * ?urface ifi tridecd perpendicular to the norn*l so defined, consider 
any pair of points in the surface { VV z o ;i and U r y r z ] ) T Connecting 
them and taking dot-product, we find that ( V * ( p V?| ) ■ fa,b,c} = Or 

Since WC shall be Interested in curved surfaces as well, we extend this 

method for specifying surface orientation by applying It to tangent planes. 

That IS, the orientation of the surface at a point f* ,y ,Z ) 3s defined 

0 □ o 

Ui be the Orientation of the tangent plane constructed at that point. If 
Che equation of the surface 5 S given as z = z(*,y}, we can takt an inf Ini* 
tcsinal Step {dx, dy* dz) rn the Surface and find that d 


1! = i in + i dy t 
x y 


Where ^ and the first parti a] derivatives of z wrth respect to 

and y respectively, dearly, the equation of the tangent plane can be 

written a&zx + z y - z » d Iwhifrp ^ - » „ * _ , i, ,. . ,, 

x y T ' ere 0 + We can i nrned i- 


y o 


ately construct a local normal U z -\I 
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jt will be tonvenl ent to abbreviate the F 3 r -S t partial derivatives as p and 
q. The local normal then becomes (p*q ± -1). It is clear that orientation 
defined In this way has but two degrees of freedom. The quantity (p.q) 
will be called the gradient. 



IHftPE INTENSITY; 

lle>tt we turn to the image Intensity- This will be equal to the amount of 
light reflected by the torrespond 1ng point on the abject in the direction 
of the viewer, multiplied by some COiiStent factor that depend? on the param¬ 
eters of the Eira-ge-forming System. To be precise, we have to think of in¬ 
tensity as light flux per unit area and COTrespondingIy also have to con¬ 
sider the reflected Eight per unit area as Scon by the viewer. 

Now the amount of tight reflected by a surface depends on its mlcro-struc^ 
tore and the distribution of the incident light. Constructing a tangent- 
plane to the object's surface at the point under consideration. One See? 
that light nay be arriving frejn directions distributed over a bemi-sphere. 
One can consider the contributions fron each of these direction? separately 
and super 1npose the results. 
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' he important point Is that r»0 tnacter how complex the distribution of light- 
sourceg, and for most kinds of surfaces* there is a unique value__of_rc~ 
flectance* and image in cans icy, for a given or Fen tat ion of^ theSurface. 

shall spend some t Erne exploring that and develop the gradient-space image 
in the process, 

SINGl£ POINT SOURCE - 

The simplest case Is that of a single point-source. it Ts easy to see that 

, i 

the geometry of reflecUon Fn this east is governed by three angles, the 
incident* the emlttance, and the phase angles. The Incident angle is the 
angle between the Incident ray and the local normal* thE emittance angle 
3s the angle between the emitted ray and the local normal* and the phase- 
angle Is the angle between the incident and emitted ray [4J+ 



Clearly the cosines of the three angles can be found simply by taking the 
dot-product of the appropriate pair of ynit vectors. The reflectivity 
function is a measure of how much of the light incident on a Surface ele- 
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ment rS reflected in a particular direction.. Roughly Speaking, it is the 
fraction of the incident light reflected per unit surface area,, per unit 
solid angle, in the direction of the viewer. 

Let the 11 Turn inat ion he E (f I ux/ ufl i t area) and the resulting surface I cirri— 
manes Tn the direction of the viewer be H (FIux/steradian/prpjecled area}, 
Projected area is simply the equivalent area if the surface was not fore¬ 
shortened , that Is* if It was normal to the vrcw-vector, The reflectivity 
is sinply defined as S/E, It 1$ usually written $(i,e,g). 

Hole that an infin1tesima1 surface element, dA, captures a ftux E cos(i)dA, 
Since its surface nornaI is inclined T t relative to the Incident ray. 
Similarly, the intensity I{fIux/stefadlan) equals 6 cosfeJdA, since the pro¬ 
jected area is foreshortened by the Inclination of the surface nornaE rela¬ 
tive to the emitted ray. 

REFLECTIVITr FUNCTION: 

ha thena t i ca 1 models have been cons t ructed for son*e surfaces that allow 
On analytical determination of the reflectivity function. Such techniques 
have not proved very successful 50 far, 

Jh general wc may not just have a single point-source illuminating the 
object -- Other objects around it, For example, wTII contribute to the 
incident light. In this case, On* has to integrate the product of the re¬ 
flectivity function and the Incident light per unit solid ingle over the 
hemp-Sphere visible from the point under consideration Jn order to deter- 
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mint the- total Ught Hu* reflected In the direct Ton of the viewer. 

TYING IT ALL TOGETHER? 

So far we have treated geometry and Intensity separatefy, The normai to 
the surface relates object geometry to image Intensity, The normaF is 
defined In terms of the surface geometry, and it also appears In 
the equation for the reflected light intensity since the three angles dex¬ 
tern in ■ng reflectivity depend on it. One could now proceed to develop 
partial d i fferentia1 equations based On this observation -- it is more 
fruitful to Introduce another tool f i rs t f grad Tent^spacE. This will allow 
MS to gain valuable intuitive insight Into hew one can exploit the detailed 
understanding of Image format ion- 

Gradient space: 


Grad lent “-space can be derived as a projection of duai-space or of the 
Gaussian sphere, but it is easier for Our purposes here to relate ft direct^ 
ly to surface orientation (2], We will concern ourselves with orthographic 
projection only* aTthough some of the methods can he extended! to deal with 
perspective. 

The mapping from surface orrentatron to gradient^spoct is stealgbt-forward * 

If we construct a normal (p t qj^l) at a point on an object, it maps Into the 
point !p,q) in grad 1 ent“space, Equivalent ly, one can imagine the normal 
placed at the origin and determine its Intersection with a plane at unit dis¬ 
tance form the origin. If we write the equation, for the surface 2 » z{x,y) t 
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then a normal to the surface wilt he (^, 2 ^,- 1 ), wher* z x and are the 

firsE partial derivatives of 2 with respect to x and y respectively. 

Clearly, p = z anti q * z , 

X y 

Ue heed to took at some examples to gain a feel for grad l iftt“space* Evi¬ 
dently d plane maps Into a point [ft gradient-space. A second plane parallel 
to the first naps Into the same point. What plane maps rpto the point at 
the origin In grad Pent"Space? A plane with normal {0,0,-i), that is* a 
plane perpendicular to the view-vector (G*Q*-T)* 

Moving away from the origin in gradient-space* one finds that the distance 
from the origin corresponds to the inclination of the plana with respect to 
the vtew-vector — specifically* the distance from the origin equals the 
tangent of the angle between the surface-normal and the v iew-veCtdr* ian(e). 

If we rotate the object-space about the view-vector, we induce an equal 
rotation Of gradient-space about the origin* This allows US to line up 
points with the axes and so simplify analysis. Using this technique it Is 
ca&y to show that the angular position of a point in grad Ient—space corres¬ 
ponds to the direction of steepest descent on the original surface., 8tt , 

Let us call the orthogonal projection of the original spate, image-space. 
Usually this is ail that Ts directly accessible to us. Two planes inter¬ 
sect in a lino. Let us tall the projection of this line the Image-1 Ire , 

The two planes, of course, also correspond to two points in gradient-space. 
The line connecting these two points Fs called the gradient-1 Ine, Thus* a 
line maps into a line. The perpendicular distance of the gradTent-space 


line from the origin equals the tangent of the inclination of the original 
line to the Image plane. 


(1 can be shown that IF the gradient-space were to be super Imposed On the 
image-Space, an image-line wOu1d be perpendicular to the correspond iny 
gradient-spice line, Mackwrth's scheme for scene analysis of line-drawings 
0-f polyhedra depends on this observation [il - 

IRf-HEDRAL C&RbERS: 


The points In gradiemt-soacc, that correspond to the three planes meeting at 

a tti-hcdral corner, have to satisfy certain eonstdlntt, The lines connect¬ 
ing the&e points have to be perpendicular to the corresponding lines In 
fmage-space, 
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IMAGE SPACE GRADIENT SPACE 


This provides us with three constaEnts -- not enough to fix the position of 
three points in gradient-space. Three degrees of freedom are still undeter¬ 
mined, namely the position and Stale of the triangle, shall see later 

that measuring the three Intensities provides enough information to dis“ 
amblguate the orientation? of the planes, and thus allows a determination of 
the three-di mensiana I Structure of a polyhedral scene. 
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ERAUi 1 ENT-5FACE IMAGE: 

The amount of ] T cfh C reflected fey a given surface element depends on its 
orientation and the distribution of !ight-sources around F t, as well as or, 
the nature of its surface. For a given type of surface and distribution; 
of light-sources, there is a fixed value of reflectance for *v#ry orienta¬ 
tion of the surface normal and, hence, for every point In gradient-space. 
Image intensity is a single-valued function of p snd q. We can think of 
this as a grad lent-space image. This is not a transform of the Image seen 
by the viewer. It is. In fact* Independent of the Scene and a function of 
the surface properties and the Ught-SOurce distribution, fjqte that we 
have assumed that both viewer and light-sources are far from the objects 
In the scene. 

the use of the gradjent-space diagram Is analogous to the uSe of the hodo- 
gram or velocity-space diagram. The later provides Tpsight into the motion 
of particles In force fields that is hard to obtain by algebraic reasoning 
alone. Similarly* the grad 1 ent-Space wf11 allow geametric reasoning about 
Surface orientation and image intensities. 
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HAT SURFACES Afcp PCMHT-50URCE NEAP. VIEWED 

Some examples wTH make this clear. Consider a perfect lambertlan Surface. 

A perfect diffuser has the property that it looks equally bright from all 
d tree Lions and that th-c amount of 1 igfit reflected depends only on the cosine 
of the incident angle. In order to postpone the calculation of incident, 
eminence, and phase angles from p and q for now, we will place a single 
1ight’SOurce near the viewer. Then the incident angle equals the amittancc 
angle and Is simply the angle between the surface normal and the View-vector* 
its cosine is Just the dot-product of the corresponding unit vectors. 

That is, 


MStl> = , Jj>,g,-0- (P, « i fj\ + p 2 + q 2; 

[ I (0,0, ~l)\ 

The sane resuit CPU Id have been obtained by remembering that the distance 
from the origin in gradient space Is the tangent of the angle between ihe 
Surface-normal and the view-vector; 

/p 3 + q 2 = can(c) and cos 2 (e) • I/ll + tan E le)] and e « t here. 

If we plot reflectance as a function of p and q,, -we get a Central maxi mum 
of one at the origin* and a Circularly synnetric function that monotonteaHy 
fatts^ to *ere as one goes to Infinity in gradient space. This is a nice* 
smooth grad lent-space image, typical of mat surfaces. 


A given Image intensity corresponds to a simple iocus In gradIcnt-space t a 
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circle centered on the origin. A measoreinent of inage intensity tells us 
that the surface gradient has to be one that fa Ills on a certain circle in 
gradTent-space, 

UNIFQAH | ULUhI MAT IQN; 

Mote that the case of uniform illumination is quite similar to the situ¬ 
ation where the light-source is near the viewer. For a start, there arc 
no shadows in either case. Secondly, in both oases the reflectivity can be 
written as a function of the emlttance angle alone. In fact s we can define 
an equivalent reflectivity function* 

*■' M - / T ij-(i»e»g) sln(l) clAdi 

O ¥ 

for thE uniformly fr ruminated Surface. Were A is the azimuth angle defined by 

C°5 (g) - cOs(i)cos(e) 

CoS (A) = ---——- 

sinf i)sTn(e) 

In general, the Tight-source is not likely to be near the viewer, so 

we will have to explore the more compl 1 cated geometry of Incident and emitted 

rays for arbitrary direction® OF incident light St the Object. 
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Contours of constant £ - cost's)- Contour intervals are + 1 units wide. 
This is Che grad lent - Space image for objects with lambertian surfaces 
rthen there is a single 5 ight-sc-urce near the viewer. 


+ 13 
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IHCIBENT, EHITTAHCE, AND PHASE AN6LE5: 

For many surfaces the reflectance is a smooth function of the incident, 
effllttarcce, and phase angles. 



it is convenient to work with the cosines of these angles, t = cos(i), 

F = COS (t) , and! G = cos{g) -- sine* those can be obtained easily from dof 
prodticts Of the three unit vectors, Suppose for now that wft have a single 
distant 1 I ght-source and that [ts direction is given by a vector {p ?t qi ± -)) H 
The view-vector Is fQ*Q*H)‘, soi 

G * l//i + p^ + £T g 2 , E m 1 /A + p^ + q z , and 
] = < r + p & p + q s qj /{A + p £ + q 2 A + p^ + = (I + p^p + q__q}EG 

Evidently it fs simple to calculate J* E, end ti for any point in gradient- 
space, In fact G Is constant given our assumption of orthogonal projection 
and distant 1ight-SOUrce, We have already seen that the contours of constant 
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E are cl rcl es Tn 9 T*d I ent “Space centered an the origin. Setting l constant 
gives us a second-qcder po1ynornfa1 En p and q and suggests that loci of 
constant a nay be conic sections. The terminator, the line Separating 
lighted from shadowed regions, is a straight line, ahtflined by Setting 
i - w/£„ Here 1 = Eli that Is, I + p_.p + q s q = Q, Similarly, the locus 
of I = t is the single point p • p^ and q = q . 

A geometric way of constructing the loti of constant I is to think of the 
cone generated by all d lections that have the same Incident angle. The 
ajtfs of the tone is the direction to the 11ght“source (p ,q , ~f). The 
corresponding points in grad 1 ent-space are found by Intersecting this cone 
with a plane at unit distance fran the origin. Varying values af I will 
produce cones with varying angles. These cones will form a nested sheaf. 
The intersection of this nested sheaf with the Ltnit piano will be a n e sted 
set of conic sections. 

If we measure a particular image intensity, we know that the gradient of 
the corresponding surface element has to fall on a particular one of the 
conic sect ions. The possible normals arc then confined to 8 cone. In this 
case this is simply a circular cone. In the case of more general refloitiv 
ty functions* the 10CU5 of possible nOrraIs will constitute a more general 
figure Called the MOfiye Cone. 
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$hadow line 


Contours of constant I = cos(i}^ Contour [ntervs 15 are ,1 units wide. 
The direction to the source fs (p^q & } * fO-7»0-3) , 

This I S- the gradient-space image for objects with iarrbertian surfaces 
when the ]Ight’Source is not near the viewer. 
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SPECULARITY; 

Many Surfaces are not completely Tiat* having some Specular reflection from 
the Outermost layers of their surface. Tb \5 Ts particularly true of sue- 
fates that are smooth Oh a microscopic scale- For specular reflection we 
have 3 ™ e and the Incident,, emitted, and normal vectors are all In Lhe 
same plane. Alternatively, we can say that 1 + e = g, In any case, only 
one surface or1enta Eion will be just right for reflection of the Iight- 
source towards Ehe viewer. That Is, perfect specular reflection Contributes 
an impulse to the grad 1 erit-space Image at a particular point. 

In practice, few Surfaces have such perfect Specularity. Instead they 
reflect some 1 Tght in the direction slightly away from the geometrically 
correct direction [SJ T It can be shown that the COSinc of the angle between 
the direction defined by perfectly specular reflection and any other dlrec- 
tlon Is (2IE-G), This will clearly equal one In the correct direction 
and fall off towards zero as one increases the angle to a right-angle. 

By taking various functions of (2IE-G) one can construct more or less com¬ 
pact specular contributions. Raising this function to some large power, 
for eaanvpfe, wi II do. 

A good approximation for some glossy whTte paints can be obtained by com¬ 
bining the usual mat component with a specular component defined In this 
way. For example, $(!,£.&) * (n + 1)(£IE - G) n + (1 - s)i w jn work. 

Here 5 varies between 0 and 1 and determines the fraction of incident 
light reflected specularly before penetrating the Surface, while n deter¬ 
mines the sharpness of the specularity peak in the grad lent-Space image. 


1 
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Contours for ■ * 5 S(n + tK2lE - G) n + (I - S) . This is the gradient- 

space Swage for a surface with -both a matt and a specular ewiponen't of re¬ 
flectivity illuminated by a singte point-source. 
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FINDING p AND q FROM t. E. AND G: 

In order to explore further the relation between the speciffeat ion of 
surface orientation In grad rent-space and the angles involved„ we shall 
solve for p and q, given I, E„ and C, tfe have already shown that it is 
sirrpFe to perform the opposite operation, One way of approaching this 
problem Is to try to solve the polynomial equations in p and q, derived 
from the equations for i, E, and G + This turns out to be messy, but ft 
can be shown that: 


Wh ere 


P “ p r COS (0) - q 1 slnffl} 
q * p v sin{ej + q' cos fa} 


p- - an , . aWtt 

/1 - G 2 A - & 2 


A 2 * I * 2IE& » (3 2 + E a + G ? } 


cqs{R) 


i P 2 + tf 5 
1 K s H s 


and sin(S) = 


+ qj 


It is inmedlately apparent that for most values of I, E h and G„ there are 
two solution points in gradient space, Notice that 6 here is the direction 
Of the light-source in gradient-space; Lhe lino connecting (p^q^) to the 
origin makes an angle 0 with the p-ax>S, So p H and q 1 are coordinates 3n. 
a new gradient-space obtained after simplifying matters by rotating the 
axes until = 0 -- the light source 3s In- the direction of the x'-axis. 
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The fttxt thing mrth noticing about this set of equal To^S is that if I/E 
Js constant,, then p' is constant (remftnbcring that G Is constant anyway) „ 
So the loci of constant I/E ara straight lines. These line? ere all para¬ 
llel! to the terminator^ for whTch I - -0. This turns out to be Important 
since some surfaces have constant reflectance for constant I/E. 



Contours of $(L P E f G} = I/E. Contour intervals are .2 units wide. The 
reflectivity function for the material fn the maria of the noon is con¬ 
stant for I/F. 






METALLIC SURFACESr 


C Qn& rd c r next * retail]* .urfac^ □ surface with a purely specular ref|ectance. 
Each point in grad lent-space CO t responds to a particular direction of the surfa 
normal and defines a direction from which Incident light has to approach 
the Object in order to be reflected towards the viewer. In fact, in gradlenf 
spac-e we can produce a complete map of the sphere of possible directions as 
seen from the Object. At the origin, for example* we have the direction 
towards the viewer. ff we record an intensity In the gradient Space corres¬ 
ponding to the intensity arriving at the object from the corresponding direc¬ 
tion we obtain a picture of the world surround Ing the object. Jn mep pro¬ 
ject ton terms wc have a plane projection of a sphere with one pole of the 
Sphere as the center of projection. Another way of looking at It Is that 
the image we construct in this fashion Is iIke one we would obtain fey look¬ 
ing into a convex mirror — a metallic paraboloid to fee precise. 

rfha; can we do wi th this Strange Image of the world surrounding the object? 

If wb measure a certain intensity at 0 given point on the object, we can 
now Say something about the orientation of the Surface at that point. We 
cannot uniquely determine that orientation, but we do know that it is re¬ 
stricted to a sub-set of all possible orientations. Ue have one constraint 
Or it -- It hus to be one of the points in gradient-space where we find 
this same value of intensity. If the world surrounding the object is at 
all complex, this sub-set will tend to be very disconnected and complex, 
and not much help in recovering the shape directly. There are exceptions -- 
I ight-SOorces, for example,, tend to be compact and very bright, correspond- 



-2k- 


ingi to definite easy-to- 1 ocate points Tn qrad ieilt-Space , For points with 
such high reflected light Intensity In the image we cam often locally de¬ 
termine the surface normal uniquely. 

We have now developed methods for constructing gradlent-spat* images for 
various surfaces and distributions of light-sources. The latter is done 
simply by Superimposing the results in grad ient-space for each light- 
source In- turn. We Will now turn to a minor flaw in th'S approach and 
attempt fl partial analysis of mutual Illumination, 




Grad ient-'Spoce ifnage for 0 metallic O-bjcct in the center of a large wire 
cube. Equivalently one can think Of it as Lhc reflection of the wire cube 
in a paraboloid with a spacelar ly-reflecting Surface, 





HUTlfAL ILIUM I NAT I ON: 


The grad lent-space image is based on the assumption that the viewer and 
aH light sources are distant from the object. Only under these assump¬ 
tions can we associate a unique value of image Intensity with every surface 
orientation. If the scene consists of a single conve* object these assump¬ 
tions may be satisfied, but when there are several highly reflective ob¬ 
jects placed near one another, mutual iliummat ion may become Important, 

That is, the distribution of incident light no longer depends only on direc¬ 
tion only, but is a function of position as well. The general case rs very 
difficult to dcai with and We shall study only some idealized situations 
applicable to Scenes made up of polyhedra, There are two primary effects 
of mutual illumination; a reduction in contrast between faces, and the 
appearance of shading or gradation of light On images of plane surfaces. 

In the absence of this effect, we would expect, plane Surfaces to have 
polygonal images of uniform intensity since all points on them have the 
same orientation, 

TUQ SEMI-INFINITE PLANES: 

First let US consider a highly Idealized situation where we have two semi- 
Infinite planes joined at right angles, and a distant light-source. Let 
tho Incident rays make an angle a with respect to one of the planes. Further 
assume that the surfaces reflect a fraction r of the light falling on them, 
and that the illumination provided by the source is E (light flu*/un1t area}. 
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Picking any point on One of the half-planes, we find that one-hflif of its 
hemisphere Of directions is occupied by the other plane, &0 Onc-haff of 
the T Ight radiated fron this point will hit the other plane,, white one-half 
will be lost. Since both planes are semi - 3nfin lte T the geometry of this 
does not depend on how far from the corner we are. Now, Che light incident 
at any point is made up of two components, that received -directly from the. 
source and chat reflected from the Other plana. Hr \% not hard to sec that 
the intensity On One plane will not vary -with distance from the corner —- 
a point receives reflected light from One-half of Us hemisphere of direc¬ 
tions no matter how far from the corner it is. Put another way, there r& 
no natural scale factor for a fluctuation in intensity. Let the illumina¬ 
tion of the planes be ^ and E^ flight fTu*/unit arEa). 

E| = + E costa) 

£ 2 ~ J sE ] + l Sinta) 
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Salving far E-j and E^, one gets; 

E| = E[cos{a) + Jjr 5 In fa)]/ [l - fer) 2 ] 

E 2 = EhinfaJ. f l^ r c0 s( Q }J/[| _ (Jj r )2] 

Had we ignored the effects of mutual FlHmination we Muld Hava found 
E, = £ cm fa) and E sin (a), Clearly the effect Thereat w Eth ]p- 

draaaes in reflectance rj It fa not significant for dark surface?. When 
the plane? are equally iEliminated, For a • n/4, we have: 

E, * E 2 = (E/^)/0 - JsrJ 

When r - I* this is twice the Ill urn [nation and hence twice the brightness 
that we would have obtained in the absence of mutual !Tlumination. 

If the angle between the two planes Is verTed. ane finds that the effect 
gets larger and larger as the angle gets more and more acute. One can 
get arbitrary "arqplifStation" by choosing the angle Small enough. Con¬ 
versely, for angles larger than ,/2. the effect is le*S pronounced. 

In the above derivation we have not made very specific assumptions about 
the angular distribution of reflected light, Just that Ft does not depend 
□n inhere the incident ray comet from and that it is Symmetrical about the 
normal. So a lambertlan surface would be Included, while a highly specular 
indeed^ the cftact ri less pronounced For surfaces wFth a 


one would not. 


high specular component of ref Icct ion, since most of the light is bounced 
tack at the source upon second reflect Eon r 

Another important thing to nDte Is that ff the planes are not infinite, 
the above calculations appiy approximately at least close to the corner. 

For finite planes we expect a variation of Intensity as a function of 
distance from the corner, but asymptotically, as one approaches the corner, 
the results derived here will apply* 

TWO TRUNCATED FlftNCS: 

ff the planes are of finite extent, the geometry becomes quite complex, but, 
If one allows them to be TnfTnrte along their Tine of intersection and 
truncates them only in the direction perpendicular to this, one can develop 
an integral equation. Suppose they bath extend a distance L From the corner 
and aro joined at right-angles and that a =■ ti/A i r This produces a particular 
ly simple Forn of this integral equation — whrch nevertheless I have been 
unable to solve analytically. Numerical methods show that the resultant 
il luminat Fon falls off rronotonica 1 Iy from the corner, that the value at 
the corner Fs indeed what we predicted in the previous section, and that 
near the corner, the fal l-off Fs governed by a term in . 

For t = i 3 for example, this contains the square-root of (x/L) and there 
is thus a cusp In the function at the corner* (here X is the distance 
along the plane from the edge where the planes meet). 
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Surface Turn I Hare® plotted w^rjus fractional distance from, a right-angle 
corner. The corves are for reflectances of .Z, A, , 6 + . 8 t and 1.0. 
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Surface luminance plotted versus {«/L)^ ^^ to Illustrate asymptotic 

behavior near the corner. The curves correspond to reflectances of 
. 2 , .6, .0, and | r £h 
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THE MAIN RESULTS 
THE SEMANTICS OF EDGE-PROFILES: 

If polyhedral objects were perfect, there was no mutual illumination, 

Image sensors were perfect and 1 3ghit sources distant from, the Scene, 
images of polyhedral objects would be divided Into polygonal areas, with 
intensity uniform inside each polygon. It is well known that there Is 
variation of Image Intensity within these polygonal areas in real Images 
and that an intensity profile taken across an edge separating two such 
polygonal regions does not simply have a step-shaped transition Tp inten¬ 
sity. Herskovitz and Bfnfard determined experimentaI } y that the most 
C Orman edge transitions are stop-, peak-, and roof-shaped [7 ]. This has 
SO -far been considered no more than a nuisance, since It oompl TcatcS the 
process of finding edges. Here we will discuss the interpretation of these 
profiles in terms of the three-dimensional aspects of the scene. 




ROOF 
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IMPERFECTIONS QF FQLYflEDRflL EDGES; 

A perfect: polyhedron hus a discontinuity i n surface noffflS I it an edge, 
i n practice edges are rounded off somewhat, A cross-settion through the 
object r 5 edge shows that the surface normal varies smooth Iy from one value 
to the other and takes On vatues that are linear combinations of the sy r- 
face normals of the two adjoining planes. 



What does this mean- In terms of reflected light intensity? Instead of a 
sudden jump of intensity From a value corresponding to the one Surface normal 
to the other t the intensity varies smoothly. The important point Is that it 
may take on vatues out side the range of values defined by the two planes. 

The best way to see thfs Ts to consider the situation in gradient-spate. 

The two planes define two points m grad fenI-space and tangent planes on 
the corner correspond to points on the line connecting these two points. 

If the image intensity is higher for a point somewhere on this line, we- will 
sec a peak in the intensity profile across the edge. 


$0, if we find an edge-profile with a peak-shape or a step with a peak super- 
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ImpOScd* it I? most likely that the [ i JVC should be labelled convey. The 
converse 3s not true, an edge may be convex and not give rise to a peak, 
if the line connecting the two points in gradient space has Intensity 
varying rnonoton leal ly along Its length, The identification is also not 
comple-te I y Certain since under peculiar lighting conditions and with ob¬ 
jects that have acute angles between adjacent feces, a peak may appear at 
an obscuring edge. 

Notice that the peak is quite compact t since r E only extends as far as 
the rounded-off edge does, 

At a corner, where the planes meet* we find that surface imperfec¬ 
tions prov ide surface normals that are linear combinations of the three nor¬ 
mals corresponding to the three planes. In gradient space this corresponds 
to points in the triangle connecting the three points corresponding to the 
planes. If this triangle contains a maximum Tn Image intensity we expect 
to see a high-light right on the corner. 



Image oT tri“hedral corner and corresponding grad i «nt-space diagram, 
The image intensity profile across the edge between face A and face 
B will h a ve a peak or highlight. Th-e Others wi \ 1 not, 
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MUTUAL ILLUHI NAT I OH; 

We have already seen that mutual 3 1 Urination gives ri^ to Intensity varf- 
at Jons on planar surfaces. The intensity falls off as one moves awa y from 
the corner. Near the corner, this fa II-off J s approximately 
Imear, Notice that this affects tha Intensity profile over a large dis- 
tance fron the edge, quite unlike the sharp peak found due to edge Imper¬ 
fections, Clearly* If we find a roof-shaped profile or Step wTlh a roof- 
shape Super Imposed we should consider labelling the edge concave. 

The identification U not perfectly certain, though, since some imaging 
device defects Con produce a similar affect, Image dissectors, for example. 
Suffer from a great deal of scattering and this has the effect that areas 
further from a dark background are brighter. So one may see a smoothed 
version of a roof-shape In the middle of a bright scene against a dark 
background, E«pef linen tat Fan with high-quality Image input devices such 
as the PJ N-dlode m I rror-def 1 ection system has confirmed that this fs an 
artiFact Introduced by tha image dissector. 

Further, when the light-source Is close to the scene, significant gradients 
can appear on planar surfaces as pointed out by Herskoviti £, & 3 nford [ 7 ] . 
Lastly, the roof-shaped profiles on the two surface may be due to mutual 
Illumination with other surfaces, not each other, nevertheless, a roof- 
shaped profile does usually suggest a concave edge. 



OBSCURATION:: 
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SCc-p”5Kap-ed Intensity profiles most often occur where objects obscure 
one another, although they can be found with convex and sometimes con¬ 
cave edges as well, If the obscuring surface adjoins a se1f-shadewed 
surface, however, edge rmperfectIons will produce a negative peak on the 
profile, since the line connecting the points corresponding to the two 
surfaces fn gradiert-space then passes through the terminator. So a nega¬ 
tive peak or a step with a superimposed negative peak strongly suggests 
obscuration. It Fs unfortunately impossible to tell which side 5s the 
Ob SC v r T ng pIane„ 



-17- 



Gen era t Jon- of j negative peak at an ol«cur frag edge Facfnq ji*av 
r rom t Kfc ] 5 g h t - sou rc e, 
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DETERHIHING THE THREE-&IJQS1ONftL STRUCTURE QF PQLVHEPRAl SCENES: 

The approach invented by Ka c k'/of t h for understanding I i ne-d raw i ngs of 
polyhedra allows one to take into account some of the quantitative aspects 
of the three-dimensional geometry of scenes [2], It does not, however, 
allow One to determine Fully the orientation of all the planes- The scale 
Ond position of the gradicnt-spacE diagram is undetermined by his techmque- 
Tq illustrate, Consider a single trihedral corner. Mere we know that the 
three points in gradient-space that represent the three planes meeting at 
the corner have to satisfy certain constraints. Specifically* they must 
tie on three lines perpendicular to the lmajs-1Ines. 




tt takes 5 E* parameters to specify the position of three points on a plane, 
so we stFt I have three degrees £>f freedom after introducing these constraints- 
Measuring the three image EntensTtres of the planes supplies another three. 

The constraints are due to the fact that the points in grad iOnt-SpaCe have 
to lie on the right contours of image intensity- The triangle can be 
stretched and moved untH the points correspond to the correct image inten¬ 
sities as measured for the three planes. Since this process corresponds 
to solving three non*linear equations for three unknowns, we can CXpfiCt £ 





finite number of solutions. Often thci'E are but one or two. some 

can be eliminated from prior knowledge of what 25 to be expected In the 

scene - 

When more than three planes meet at a corner, the Situation is even more 
constrained — the equations are over-determIned. Conversely, one cannot 
do much with just two planes neeting at an edge, since there are too few 
equations, and an Infinite number of solutions exist* as one might expect. 

The possible ambiguity at a trf-hedral corner is not very serious when one 
considers that In a typical scene there will ibe many "connect" edges* either 
convex or concave as determined by Macfcworth's program. Usually the over¬ 
all constraints will allow wi I/ on* interpretation that Is consistent. 

A practical difficulty is that it is unclear wbat search Strategy will lead 
One efficiently to this Interpretation, 

Measurements of image intensity are not very precise and surfaces have 
properties that Vary from point to point and with handling. We cannot 
expect this method to be extremely accurate In pinning down surface orienta¬ 
tion, The fact that for a typical scene the equations will be Over-deter¬ 
mined allows a 1 east - squares approach which may help to Improve matters a 
little. 

The idea of stretching and shifting can be generalized to smooth Surfaces. 

We know that the image of a paraboloid Is the gradient-space Image, If 
we can stretch and shift a real Image of some object to fit this pattern 
0 intensity distribution we can determine its surface shape hy applying 
she Inverse 31 retch mg and shifting to the paraboloid. 
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HIWAR TQP&GRAPNV: 

U.hien viewed from a ■great distance, the material 3n the maria of the imoon 
ha* a particularly interesting reflectivity Function, First,, note that 
the lunar phase is the angle at the moon between the llght-SOurcc (son) 
and the viewer (earth), This is obviously the angle we call 9 , and ex¬ 
plain! why wc use the term phase an^le for g. For constant phasE angle, 
detailed niFasurenents using surface elements, whose projected area as seen 
from the source is a constant multiple of the projected area as seen by the 
viewer, have shown that all such surface elements have the sane reflectance, 
Bui the area appears foreshortened by cos(I) and cos(e) as seen by the source 

rand the viewer respect ive fy, Hence the reflectivity function Is constant for 
constant cos £ 1)/cos(ft) “ I/£ (for fiyed G), 

Each surface element scatter? light uniformly InEo Its hemisphere of 
directions, quite unlike the lambertian surface, which Favors directions 
normal to its surface* This is not an isolated incident. The surfaces 
of other rocky, dusty objects when viewed from great distances appear to 
have similar properties. The Surface of the ptenet Mercury, for example, 
and perhaps Mars* as well as some- asteroids and atmosphere-free satellites 
fit this pattern. Surfaces with reflectance a function of l/l thus form 
third species we should add to mat Surfaces where the reflectance is a 
function Of I and glossy surfaces where the reflectance is a function of 
(2IE-G)* 



LUNAR ftEFLECl I VITY FUNCTTON: 
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Re turning to the lunar surface, w e find an early formula due to Lorrrrel- 

SeeIfrige r [G ]; 


+ [l , E h G) 


r 

o 


(il/Ej 


(p/e) + * (a) 


Here ^ [s a constant and the function X(G) \t defined by an empirically 
determined table. A somewhat more satisfactory fit to the data Is provided 
by a formula of Fesenkov's [Gj: 


T tl/E)[l + COS 2 (a/2) J 

$(i,e,g) * -2- 

(I/E) + A 0 I1 + tan ? (l/2)1 

Where T q and \ Q are constants and tan(&) * - fl/E--Gj/ZT ^ 2 r By the way, 
tsnCa) = "P 1 , This forrwla is also supported by a theoret \ ca 1 model of 
the surface due to Hapfce. Hotc that given 1, l, and G* It Is straight¬ 
forward to calculated the expected reflectance, W e need to 90 in the 
reverse direction and solve for I/E given G and the reflectance as insured 
by the Image intensity. While it may be hard to Invert the above equation 
analytically» it Should be Clear that hy some iterative, 1nterpoIafI on ( 
or h:1l-clinbing scheme, one can solve for I/E. We shall ignore for now 
the ambiguities that arise if there is more than one solution. 





- 42 - 


LUMAR GRADIENT-SPACE IHAGE; 


Next, we ask what the grad Sent-space image looks like for the lu-nar surface 
F1 I urn Fnatfid by a single point-source. The contours of constant intensity 
Fn grad Ieospate will be lines of constant l/E. But the contours of 
constant l/E are Straight Imesl So the grad lent-Space image can be generated 
from a single curve by shifting it along a straight-Iine -- the shadow-line, 
for example. The contour lines are perpendicular to the direction defined 
by the position of the source (that Is* the: line from the origin to p ,q }. 

Now what Information does a single measurement of i rrcage intensity provide? 

It tells us that the gradient has to be on a particular Straight line. 

Again, we shall ignore for the Foment the possible existence of irore than one 
contour for a given Intensity. What wc would Tike to know of course is the 
orientation of the surface element, Wc cannot determine completely that focal Hy, 
but wc can tell what its component will be in One direction, the direction 
perpendicular to the contour lines. We can tell nothing about it in the 
direction at right-angles to this favored direction. In fact* knowing l/E and 
G determines p 1 , as previously defined and tells up nothing about q‘. 
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This favored direction lies in the plane defined by the source, the 
viewer^ and the surface element under consideration,. If one wishes, one 
can simplify maters by rotating the viewer’s coordinate system system uitiF 
the X axis lies in this piano as well. Then q s - 0, and the contours of 
constant intensity fn grad lent'space are ail vertical lines. Evidently, 
an image irtens i ty measu rement determ ines the slope of the surface 5n [he 
*' direction, without telling us anything about the slope En the y' direct Ton, 




We 3rc now read * tQ integrate out the surface by advancing in the direction 
in which we can locally determine the surface slope. 




























FE«D(HG a SURFACE PROFILE BV INTEGRA!r : ui ; 


We have: 


pi a dz = l/E - G 
ds /] -G^ 

The distance s from some starting point is measured [n the object CO*r- 

<!mate system and Is related to the distance along the projection of this 
curve in the image by s' - sff/z }< 

' JTW ' 


dz B f I/E - G 

ds" z tT^S 5 

y 


Integrating, we get: 


if* 1 ) 


z 4 r <i/E 
° z o Jo /T~r-^ 


ds 1 


Where P/E is found from G and the image intensity 


bU'tY 1 ) by * ; 


E/E = T s [b{x' a y'J] 

Starting anywhere in the Erage, we can integrate along a particular fine 
and find the relative elevation of the corresponding points on the object. 


The turves traced out on the objoot in this fashion arc railed character I si 1 15 ■ 
their projection In the image pla 
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tlca r that Che base characteristies here are parallel strarght Nines in 
tbe Image, Independent of the object's, shape, 

FINOIHG THE WHOLE Silk MCE: 

toe can explore the whole image by choosing sufficient starting points aFong a 
line at an angle Co the favored direction. In this way we obtain the surface 
Shape over the whole area recorded in the image, 




to know an Initial curve, Of use assumptions of reasonable srraothocSS, 
Alternatively, we can perform a second surface calculation from an Image 
taken with a different source-surface-observer geometry. In this case, 
we will obtain solutions along 1 Fries crossFng the surface at a different 
angfe and can so- tie the two solutions together. ThFs Fs not quite as 
M&eful as one might think at first,, since it does not apply to pictures 
taben From earth. The plane Df the Sun, moon, and earth varies little from 
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Che ecliptic plane* The lines Of integration in the image will vary little 
In inclination. This Idea does work for pictures taken close to the mOOn, 
to the moon. 

AhHiCDlTV IN LOCAL GRADIENT: 

What if more than one contour In grad 1ent-space corresponds to a given in¬ 
tensity? Then we cannot tell locally which gradient to apply r If we are 
integrating along some curve, however, this Is not a propterr, since we may 
assume that there is little change In gradient over small distances and 
pick the one close to the gradient last used. This assumption of smooth¬ 
ness leaves us with one renainlng problem: what happens if we approach a 
flWXiftkjm of intensity in grad 1 ent-space and then enter areas of lower inten¬ 
sity, Which side of the local maximum do we slide down? This i5 an 
ambiguity which cannot be resolved locally, and the solution has to be 
terminated at this pointr Under certain lighting cond1t i ons the Image will 
be divided into regions inside each of which we can find a solution. The 
regions will be separated by ambiguity edges, which cannot be crossed 
without making an arbitrary choice. 
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LOU SUK-ANGLES; 

• h-. s problem can be entirely avoided Ef one deals only with picture'- taken 
at low s urt-ang 1 cs,, since the gradient is then a single valued function of 
image intensity-- This is a good Idea In any case, since the accuracy of 
the reconst ruction will depend on how accurately one can determine the 
gradient, which in turn depends on the spacing of the contour tines In 
gradient"?pace. If they *re close together * this accuracy wilt be high; 

near a n-iaximum* on the Other hand, it will be low. U U easy to convince 
oneself that picture? taken at low sun-angle have “better contrast," show 
the *'ret i«f in nore detail™* and are “'easier to interpret". 

There is another reason for Interest in images Obtained under conditions 
of low sun-angle. Near the shadow- 1inc in gradient-space* the contours 
ot constant-intensity ate nearly straight lines even if we are not dealing 
with the Special reflectivity function for the lunar material! Ah early 
solution to the problem of determining the shape of lunar hills made u&e 
of thi? fact by integrating along lines perpendicular to the terminator [5]. 

DEALING WITH SHADOWS; 

Working at low sun-angles Introduce? another problem of course. Since 
shadows are likely to appear. Fortunately, they are easy to deal with 
since wc can simply trace the line in the image until we again see a 
lighted area. Since we know the direction of the rays from the source 
wc can easily determine the position of the frr&t lighted point. The 
integration is then continued from there, In fact, no special attention 




has Eo be paid to this problem* s Trice a surface element oriented for grazing 
incidence of light will already have the correct slope. Thus simply looking 
up the slope for zero intensity and Integrating with this value will do. 



Some portion of the surface of course will not be explored because of 
shadows. Host af this area will be covered If One takes one picture just 
after "sun-rise" and 00c just before ’'sun-SSt". 

GENERAL NATION TO PERSPECTIVE PROJECTION; 

All along we have assumed orthographic projection — looking at the surface 
from a great distance with a telephoto lens. In practice, this is an un¬ 
reasonable assumption for pictures taken by artificial satellites near 
the surface. The first thing that changes Fr the rare -general case of pet - 
spectEve projection is that the Sun-su rface-vI ewer plane is n & longer the 
same for all portions of the surface imaged. Since it Ts this plane which 
determines the lines aforg which wo integrate, we can expect that the 
Sines of integration wiI I no longer be parallel, I 


nstead they ail converge 
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an the anti-solar point — that Is, the point in the Image which corresponds 
to a direction directly opposite to the direction towards the source,. 



The ne*t change is that z Is no longer constant in the projection equation. 
So s’ = Hence, 


. = dz f dz 3/E - G 

ds z ds p /I - G 2 


We can no longer simply integrate. But it is easy to solve the above differ 
ential equation for z by Separating terms; 


lrjg(z} = — f •—-— ds' and so zts’j 

f 1 - G2 


z 

C 


If* ’■ t/E - G 

° /n^p 


■ds 1 


Finally, note that the phase angle g l s no- longer constant. This has to 
he taken into account when calculating l/E fron the measured image intensity 
On the whole, the process is still very simple. The paths of Integration 
are predetermined straight lines in the linage — radiating from the anti- 
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5 oUr point. At each point we measure the image intensity, determine what 
value Of I /£ will give rise to thru \mtje Intensity, Then we calculate 
the corresponding slope along the straight line and take a small step. 
Repeating for ail lines crossing the image we obtain the surface elevation 
all points In the linage. 

The same result could have been Obtained by a very painful algebraic 
method M- 


A -NOTE ON ACCURACY ; 

Since image Intensities can only be. determined with rather limited precision,, 
one must expect the calculation of surface coordinates to suffer from errors 
that may accumulate along characteristics. A "sharpening 1 ' method that relates 
adjacent character! st i C£ Cdh reduce those errors somewhat l J l] , It further 
appears that an objects shape Is better described by the orientations of 
Its surface normals than by distances from the viewer to points on its SurFace. 
In part this may be because distances to the surface undergo a more complicated 
transtormatTon when the object is rotated than do surface normal directions. 
Note that the calculation of surface normals Is not Subject to the cumulative 
errors mentioned. 

Finally, It should be pointed out that the precise determinal IOn of the 
surface shape Is not the main Impetus for the devlopm*nt presented here. 

The understanding of hew imago intensities are determined by the object t 
the lighting and the image forming system is of more importance and may 
lead to interesting heuristic methods. 
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general j^efleetivittt functions: 


The staple method developed for lunar topography (Joes not apply If the 
contours of content intensity in gradient-space are not parallel straight 
Hoes, W e Shall Still be able to trace along the surface, but the direction 

l ' T Lake aL each {f °' nt w111 nDw depend on the image and will change along 
the profile. The base character 1sties will no longer be pre-determined 

straight lines i n the image. At each point on a characteristic Curve we 
shall find that the solution can be continued only In a particular direction. 

Jt Will also appear that we wr 11 need more information to start a solution 
and Shall have Co carry along more information as we proceed. Reasoning 

from the gradient-space diagram can be augmented here by some algebraic 
manipulation. 


Let &{p t q) b e the intensity corresponding to a surface element with a 
gradient Let b(x,y} be the intensity recorded In the image at 

the point C*.y). Then, for a particular surface element, wc must have 


afp,C|) = h(jc,y) 

i*<™ suppose we want to proceed Ip a manner analogous to the method 
developed eari;, r by caking a Sma t \ * tep fdx.dy) in the iHiagej , t is e|( . af 

that we can calculate the corresponding change in z as follows: 


dz - dx + dy = p dx + p dy 

To do this we need the values of p and q, As we integrate out the curve 




C A¬ 


w a 1 SO have to keep track of the values of the gradient* We can calculate 
the increments in p- and q by; 

dp - p dx + p dy and dq ■ q dx + q dy 

x y x y 

At first, we appear to be getting Into more difficulty, s F nee now 

we need to know p t p - q end q . in order to determine these unknowns 

x y x y 

we will differentiate the basic equation a(p,q) = b(x,y) with respect to 
x and y ; 

a p * a q =■ b and a p + a q ■ b 

p r x qx x py dy y 

While these Equations contain the right unknowns, there are only two 

equations, not enough to solve for three unknowns*■ Note, however, that 

we do not really need the individual valuesi We are only after the linear 

combinations (p dk + p dy) and (q dx + q dy) , 

X ¥ x y 

We have to choose the direction of the *ma 11 Step (dx f dy) properly to 
allow the determination of these quantities, Thera is only one such direc¬ 
tion, Let (dx,dy) “ (a *a )ds* then (dp.dq) " (b ,hJds, This is the 

P 4 x y 

solution we were after, Summarizing, wo have five ordinary differential 
equations: 

x = a , y “ a , t * pa + qa , p = b , and q w h 
p cj p p x y 

Here the dot denotes differentiation with respect to s, a parameter that 
varies along the solution curve. 
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INTERPRETATION IN TERMS OF THE SftftPIENT-SPACf; 

As we solve alongi 3 particular characteristic curve on the object, we 
simultaneously trace dot a base characteristic rd the inage and a curve 
in gradient-space, At each point in the solution wo wit l know which point 
In the image and which point in the grad 3 ent-space the surface element 
under consideration corresponds to. The intensity in the real Image and 
in the gradient-space Image must, of course, he the same. The paths in the 
two spaces art related in a peculiar manner. The step we take in the Image 
will be perpendicular to the contour In gradient-space and the step wo 
take lh gradient-space wilt he perpendicular to the intensity contour in 
the rfrui image. 
















GENERALIZATION TC NEAR. SOURCE AHO WEAR VIEWER.: 


The last sol ut i on method, while correct for arbitrary reflectivity functions, 
St 111 assumes orthograph IC projection and a distant source. This is a good 
appro/imetipn for many practical cases. In order to take Into account the 
effects of the nearness of the source and the viewer, we have to discard 
the gradient-space diagram, since It 35 based on the assumption of constant 
phase angle^ The problem can Still be tackled by algebraic manipulation. 
Much as the last solution. It turns out that one is neatly trying to solve 
a first order nan-1 Encar partial differentia! equation in two independent 
variables. The we I I - known solution involves converting this equation into 
five ordinary differential equations, quite like the ones we obtained in 
the East section H]. 
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1-1ATH EM ATI' UAL P ETALS 

DUAL-SPACE: 

One approach to gradient~spbce Is to consider 1t as a projection of dual 
space [1,2,3], Dual "Space is a thfce-d 3 mens iona 1 entity obtained by rrapp f 
planes into points and points into planes, A point of course tan be speci¬ 
fied as a vector {x.y.z), A plane also can be defined in terms of a vector 
(a,b,c). The plane consists of points which satisfy the equation: 

{*,Y,z) r (a,b,c) - I Or a* + by + cz = I 

ft is cicar that a plane fn one Space can be mapped into a poEnt Tp the 
other and that, conversely, a point C3fl be mapped into a plane. These 
Operations are reversible, that Is, if wc start with a plana, find the 
corresponding point in dual-space, we cart map this point back into the original 
piane- 

What about lines? Lines can be thought of either as the intersection of two 
planes or as connections between two points. Thus, the dual of a line, con¬ 
sidered to be Formed by the intersection of two planES, can be construed to 
be the line connecting the two points in due I-Space Lhat correspond to these 
two planes, A I■n* also can bE associated with the Family of a 1 I planes 
passing through it -- its dual wfH be the Ifne formed hy mapping all of 
these planes into points. 

What docs the corner of a polyhedron correspond to In dual-space? first 
of all, 3 corner IS a point, so it must map into a plane. Secondly, It lies 
in each of the planes intersecting to form the corner, so its dual must eon- 
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tain all of the points corresponding to these planes. The dual of a corner 
Is the plane defined by the points corresponding to the planes that inter- 
sect to- form the corner. The edges of the object meeting at the corner map 
Into lines connecting these points. 

The Object-space Is not directly accessible to uS, Since *e have only a 
projection of it, the 3.mag e-space. We cannot ftwpftct to arrive at the re¬ 
sults in dual space Simply -and directly -- but it turns out that a very 
useful projection of dual“space exists. 

Given a point (a,b,c) In dual-space, one can define Its projection into 
gradient-space as (-a/c.-b/c). This is a perspective projection, how 3s 
this re fated to the original object-space7 Let a plant 3n object—space be 
defined as aK + by + « ■ | r This can also be written: 

z =■ Oa/cjx +■ (-b/c}y +■ 0/c) 

iL -s c j ea i how why i.p,q.) — {-a/c t -b/c) Is Called the gradient of the plane. 

In fact, p - and q = z^, the first partial derivatives of z with respect 

to X and y respectively. 

THE GAUSS 3AS* SPHERE: 

Another convenient way to talk about directions Is by way of a unit sphere 
surrounding the point In question [J.gl. Points On the sphere then define 
specific directions. This representation Is very convenient for some purposes 
jinee some useFuI Invariants exist Oh the surface of this sphere which aft 
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l?5t En project Eofi r Huffman uses th \ & to advantage Ert analyzing developable 
surfaces [3l% For our purposes t however, a planar represents!ion la more con 
ventent. Grad lent-space Hi sfmply a projection of the Gaussian sphere* 
with the center of the sphere acting as the center of projection and the 
projection being constructed onto a plane tangent to the sphere. 


ORIGIN OF 
GRADIENT SPACE 


0 


GAUSSIAN 

SPHERE 
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JHE fiRflDlENT-LIHE 15 PERPENDICULAR V} THE JhASE-UHE; 

Cons 1 der two planes defined by the equations? 

a t x + b,y + g,z = d, and a^x + ^ 

Tbe5c planes hays normals fa, *b ] > and respectively, The 

planes intersect in a line, The direction of this line can be found by 
taking the cross-products of the two normals. This follows from the fact 
that the line of Intersection certainly has to be in both planes and, hence, 
perpendicular to both normals. The cross-product turns out to be 

{b | C 2 _b 2 C | ,a Z c r a l C E' a l b 2^2 b l ) ' 

The image-line rs the orthogonal projection of the line of Intersection. 

US direction is simply (bjCj-^c , , 3 ^, -a ^) . 

The two pianes map Into the points and (-a^c^.-b^) in 

gradient-space. The line connecting these two points Is the gradSent-iinc. 
Its direction can be found by subtraction to be (a^e^^ /c^) „ 

I r< order to esffibl Ish that the grad Sent’ 11 fie SO defined is perpendicular 
to the image-line* we have to Show that the dot-products of their respective 
directions is zero. 


(b|C. 2 -b i c r a s c r a|C 2 )-{a 2 C|-a 1 c 21 b 2 c 1 - b iC 2 )/fCiC 2 ) - 0 

The two lines are thus perpendicular. The same result can be developed using 
only geometric reasoning. 
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IHTfcWL OF cos"(a) OVER A HEMISPHERE: 

la provide for the correct Scaling of the specular component of reflected 
1 [^ht we need the integral of cos fl {0) over the hemisphere 0 s d a; nf2 t 



the area of the strip on the surface of the hemisphere fs 2uR 3 sin(&)d$. 
Integrating, we get] 


.*/2 


J Q 2-ttiR ? 5 r n f S > c-0 s^ 1 (0 > d 0 

r ff/2 n 

cos {g)sln(e)de 


lift.* 


co5 f1 * f £s)~ 1t/2 
n + 1 J D 


2 tR 2 /(o + |) 


This Fs l/£n + I) of the surface area of the hemisphere. 
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THE QFF-SPttULftfllTT ANGLE- 

For surfaces with a specular component af reflectivity one need? to know 
tiia angle between the reflected ray and the 1 [ne of sight [BJ . This angle 
can fee found by simple application of some resul Li of spherical ■geometry. 



Here A Is called the azimuth angle. 

We are given 1, e, and g* and have to find the angle & r 

coa(a) * cos(i) cos fe) + siitfl}' sinfe) cqs(i - A) 

tos(g) = cos{3) cos(cl + sin<i) gln(e) cosfA) 

Clearly, CDS fa) * icos(i) cos (e) - cos{g) - 2IE - G 

'' il£ - e ■ k and c = G/fk + G) , then, (p “ p cl 2 + (q - g c) 2 * -— 

S S (k + G) 2 ’ 

$0, the contours of consent (2 E * S) arc circles. This also follows from 

the circle-preserving property of stereograph|c. projection. 




- 62 - 


q 



Contours of fiIE-G), The contour intervals are . 1 units. 
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GRMHEHT-SPACE I MAG£ f&R A hETftLLIC SURFACE: 

For specular reflection wc nust have two constraints satisfied; the incident 
arit|fe has to equal the err ittance angle, and the Inti dent ray f the emitted 
ray and the Surface normal have to be. top I-aria r. 

If I = then I = E and so {I + p s p + q s q)Ed = E 

And so H / 7 ”7" 

fl + p & p +■ q^q) = A + p 2 + 

Next we must have (p *q ,-T) * and (0,0 P -1) eo-planai*. That ls T 

the dot-product of any one with the cross-prndqct of the other two most 
equal zero. Expressed another way, we must have the volume of the parallele¬ 
piped defined by the three vectors equal zero. Or, finally; 


det 


p q 
r S s 

P q 

0 0 


-1 


= 0, that Is T p q - q p " 0, 
S "S 


The same result COwld be arrived at in a more round-about fashion by requiring 
that i + e = g, and then expanding cos {\ + e) “■ COS ( 9 ) , Uc now have 
equations in p and q: 


P,P + q q = A + p 2 + q 2 -1 

w af 5 


* p & q = 0 


two i1 near 
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Sotving for p arid q : 

_ Q 

p= (/I + P ^ -i) p/{p s 2 +^ 2 )- p s TTT = COSB/(l - G)/(i + G) 

^ “ {/I + -I) q £ /(P s 2 + q g 2 ) = fTT =■ sinB^fl - G) / ■( f+~^] 

This related to the half-angle formula; 

tan(*sa) = /{i] - COS a) 7 [1 + cose) 


ST E RE3GRAP HIE PROJECT I ON: 

The gradient-space Im&gc For a metalHc object is a StereQ-graphi c projection 
of the surround of the object. That Js t the sphere of possible direction as 
seen by the object Is mapped Onto a place* with the center of projection at 
one pole of the sphere, and the plane tangent at the other pole. The .mapping 
is conforms I; that is, angles are preserved. Circles on the sphere are mapped 
mapped into circles on the plane. The fa 1!cubing Illustrations from pages 248, 
25£> and 253 of Hilbert £ Cohh"Vossen [9] will illustrate: 















Fia. E-j.ji 



Fra,EUb 











A USEFUL DISCRIMINANT: 


the incident* emittante, and phase angle form a spherical triangle and 
have to satisfy Certain constraints - that is, we cannot arbitrarily choose 
l> e, and g> The Sum of any two has to exceed the third, This is analogous 
to a sirRBFar result for the sides of planar triangles. It Ts easy to see 
that only one of the three constraints tan fall at any one time [<4J, -Suppose 
Tt iS the following: 


i + e s g, then cos(i *■ e) > cos{g) 

since cosine rs mono ton fcaH y decreasing Fn the range C to tt. Expand I ng, 
one gets; 

cos(i)cos[ej - cos(g) > 5in(I)sIn{«) 

The righthand side is positive, so we can square both sides, hence: 

tie - > 0 - I 2 K1 - E-) or 1 + 2IEG - fl 5 + E z + G 1 } < 0 . 

The symmetry of this expression suggests that we would have obtained the same 
result if wo had picked either of the other two constraints. in Tact, it is 
easy to show that if i, e, and g can form a spherical triangle, then 

1 + 2IEG - (E 2 + E 2 + (J2J t 0 


and that this expression is less than zero otherwise. 



q 



Contours of the d E sc i" in*i n-ant I + 2JEG “ The lontoui' 

intery^ls are ,05 unfts, 
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A usefu 3 quantity for some ir^nipulators 3s the azimuth angle A* between 
the projection?, of the Incident and emitted ray? onto the object 1 ? surface. 
Applying a result of spherical trigonometry„ we find 

cos(g} » cog{i)cos(e) * 5in{S)sin(e)cos lA) 


So y 


cos (A) 


G - IE 


/f - I 7 " /I - E ? 


Now obvidoslyi cos (A) S 1 
Expanding, (G - IE) 2 S 0 - I 2 Hl - l 2 ) 
And SO* again. 


1 + 2 EG - (I 2 + t? + G 2 ) 2 0 
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Con tours of cos(A) 


The contour Fntervals are 


un Us < 
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EXPAND I THE tH SCSI HI NAHT: 

We would tlik? to express the discriminant Fn terms af p, q, p^ a and q . 

We will need the following! 

G = ] / Jl + |> s ^ *■ q^ 2 , and E =“■ |//j + p f -■ + q - 

X = {l + p^p + q & q) f then 1 * XEC 

t + 2i£G - (t 2 + E 2 + g 2 ) = 1 + nt 2 a* - [x 2 e 2 ^ 2 + e s + g 2 ) 

= -E 2 G 2 + 2x£ e G. 2 - X 2 E 2 G £ + 1 + E 2 &2 - E 2 . £ 2 

- -e 4 g 4 (i - x ) 2 + (i - £i)(i - c 2 ) 

- I(l/E 2 - UO/C 2 - I) - (| - X)2jE 2 G 2 

■ [fp Z + q 2 )(p 2+ q 2 ) ” fp p +■ q.q} 2 I E 2 G 2 

5r «■ S ;§■ 

- (q 5 P - p^q]* E 2 G 2 (!) 

ft is immediately apparent that the discriminant is positive for all points 
in gradient-space„ as it should be. 8ut what Ts More exciting Is that we 

have an. equation that IS linear in p and q and thus helpful If we arc going 

to try to obtain p and q, giver (, E, and G,: 

q 5 P “ P s q “ ±/f 4 2I£G - 7r 2 "+~ + G z 'l /£G 


Let 

Then h 
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_FtNPtHG p AJjp q t GIVEN I, E, AND G: 

We now have two I'near equations 1» p ,»d one from the expression for 1 
the other from the expansion of the d i scrrrnirant; 


V + V - (I/E - G)/G 
q & p - p^q - ±{i/E)/G 

where * . |, 2IEC - (|i S *J . Solving for p and „ „ get 


P • (1/6 - M/Ci^/tp^ + g^ ) ± (A/ E >/Cq 

Cp, 2 + q s 2 ) 

fl=(T/E - G}/Gq /(p 2 + q 2 J ± {iS/e) /Cp 

-- - J j _ 5 

ip 1 + <i s a ) 


i f we ] e t 


t'P ■+' n ' 

S 


£□&((?), and 


/p + q 2~ 


sin (a). 


. JiZL^lL _ and . ± bAL 

/i - W A - G 2 


then 


p = P p «s(e) - q 1 siri(e) 


q 11 O' sin(fl) + q' cOs(S) 
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D€TERM MATOF ORIENTATION OF PLANES : 

Ari example wi illustrate haw image intensity 1 nformai ion Car augment 
Mackwnrth 1 s gradient space scheme for interpreting polyhedral scenes, 
We are given a trihedral earner projected into the Fmage as follows: 




T he co r res pen d i n g grad Ient^space diagram wi tti position and Scale as yet 
undetermined Fs on the right. Mow we arc tDld that the (nornalijed) Imag-e 
intensities are *79* and .Bfi for the regions A p B p and C respectively. 

We thus have six constraints on the position of the three points in gradient 
spaefi. Given that (p^qj = (0.7*0. Jh and *{l.E,G) - I, w e tan develop 
the following equations: 


q B = "C 

K - s e > = Wf ( Pfl - p B ) 
<*>A " ’’c 1 ‘ "ft (P* - P C ) 






-7*H 


tT + ’ 7c, a + * 3 V “ ^ + V + V “THo- 

ft + -7 p b + = /! + P B 2 + 7 ^ 

fl + ,7 p c + ,3q t } - /I + p c j + q c 2 t|| 

Where we used the fact that & ~ ,80, Squaring the second set Of three 

cqu j i i un a, we obtain second-order polynomials. This simply reflects the 
fact that the points ore cons trained to He on certain conic sections. 
Uircig an iterative modified NcwtOrt-Aaphs-On method, one quickly converges 
to a solution as follows; 

{p^.q^) = (0,,70) 

{p 6 ,q & ) = {-,61, -.35] 

<P c .fl c J = {*-61, ’-35) 

The polynomials are actually simple enough that they might be solved 
directly using appropriate symbol manipulation algorithms. 

The following questions are left £5 en exercise for the reader; 

1. Is there another solution! 

2 . Are there solutions for which the three edges are 
concave? 

3. Arc the points G^, G^ as precisely determined In 
gradieni-space as the point G^, 7 
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H I u&tTat iofi of the caratre I nts on the three g rad 1 ftn t--space 
points G** C + and G , UiTs ia Che aglgtioci to the. problem of 
(fet^nriming the orientation of the three faces meeting at the 
corner* 
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MUTUAL IUUH1 NATION — FLAHgS TRUNCATED IN 0-NE EH RE CT J G M ■ 



In order to get a feel far the mutual illumination problem it helps to Study d 
simple cast first* Consider two planes Joined at right angles,, Infinite in the 
direction of the lane of their i ntersect ion* andl both of length L in the direc¬ 
tion away from their intersection. Let the incident light come from a distant 
source and In a direction fi/4 with respect to the planes. This last cond1E1 on 
and the equal lenth of the sides provide the symmetry necessary to ensure that 
the intensity distribution on the two planes Is equal. Next we will assume 
that the surfaces are lambertian* with reflectivity r. 
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How !«t Lis- calculate the total light flux received by a surface element * 
d i Stdrcc x away from the corner. First consider the contr t but Ion doe to a 
surface element on the other plane a distance y front the ■cornet and separated 
by a distance z along the direction of the line of intersection. Let the 
luminous emittanCc vary as Lfy). Then this contribution will be r for 
lambertlan surfaces. 

fr/ir) [cos(i)cosfe)]/l 2 Myjdydz fflux/unEt area) 

Merc 1 is the distance between the two points, c is the angle of enittance 
at the emitting surface element and i Is the angle of incidence at the re¬ 
ceiving surface element, 

COs(e) * x/i, cosfi} = y/1 N and l 2 = * 2 + y 2 * a 2 
So the contribution due to the patch (dy by dz) is them 

My)dy (r/ir) (xy)/l 4 dz 

Integrating with respect to z t one obtains: 

L(y)dy{r/Tr)xy j 1/£x 2 + y 2 +■ z 2 ) 2 dz 
l/(a 2 + s 2 ) 2 ds = (1/a 3 )■ (ir/zy 
So we get; L(y)dy Hr xy/(x 2 + y 2 ) 3 / 2 


INTEGRAL EQUATION: 


Finally Integral Fog with respect to y and adding In the direct contrthut ion: 

IU) = F//T+ Sir / L -^- L(y) dy 

o (x 2 + 

So here we have an Implicit equation for L(x) tailed an integral equation, 

Before we try to solve It, notice that the parameters E and L can be eliminated* 
for example, if L(x) Is a solution for incoming light flu* E, then aL{x) will 
be a solution if the light’flux is changed to aE. That Is, everything Just 
gets brighter in proportion, if we increase the incident flux. Without a 
loss of generality, we can set = I, 

•Next, lei X 1 - x/l an y 1 = yfl t then w£ find 

Ux') - 1 * 1/2r / ■ *'1' — Uy'lHy' 

15 (x> . ,■ J 

So, we can, without loss of generality, also let L = ], So we will try to 
solve; 




3 +■ hr/* 


My) dy 


This ts a Fredholm Integral equation of the second kind [I0j, Such equations 
usually Ottur as solutions to ordinary differential equations with given 
end conditions. The kernel i&, 
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M*,y) =-^-— 

{* 2 + y 2 )^ 2 


The term; I is synnetr i t, non-S^arable, arid worst of all, not bounded- There 
are a number of techniques for solving SUth equations with symmetric kernels, 
but most work only for bounded kernels, or. if one can calculate che iterated 


kernel. 



ITERATE YE SOLUTION: 


One method is iteration [toj. Suppose we Start wl th L q C «) = 0. Substituting 
this rn the rfghthantf side of the equation we arrive at the next approximation 
L[(x) = lr Using tfiis we Integrate again and find: 


L M = 1 + ^ r£l - -£- ) 

2 


The next step leads to 1 . 

L (x) = 3 + H r(l + H rR| - ) “ < *5 r) 2 xf 1 - l — , —^- 

j ■'o {** + y*)^ 2 (I + 

This last term terns out to be some messy difference of elliptic integrals 
Odd so we abandon further iteration. A few th Togs Of note emerge ( however. 
First Of ail, we Nave a useful first approximation Eii Lj(x) or the first few 
terms in L-- (x) . This approximation is particularly good for sma t f r, since 
the remaining oniitted terms are in f / and higher orders. 

Secondly,, the leading term wITT clearly become on further iteration: 

1 + h r + ( is rH + ( *s r} 2 +■ .... T/fl - r) 

And so, L(0) = 1/(1 - Is r), not too surprisingly. Next one can say some¬ 
th In g about the convergence of this Iterative process -- It will converge For 
r less Lilian 2, and diverge for r greater than or equal to- 2. Obviously, we 
care only about values for r between zero and one, so we expect a solution 
will always exist. 









INTEGRATION BY PAST & : 


Further useful results can be obtained by integrating by parts 


Lfxj - I + ] ^ r |i_ (q) - i_ (7 > 


/I 


J a L'(y) 




dy] 


Uoarly L(Qj - ] + 1 *1 r L<0) and so* once atjain* wc see that L (0) , 

I/O - iHr). This result depends go the fact that the integral i g £crD for 

* ' WHEch Can te Sf ™* n b * ^PpJ^ng L'HospJtol's rule co the resulting 
and*terminate fom, By a Eedious method of Tittle interest here, one tan 
arrive at another approximation: 


L(«| - t ♦ n - ,0 - %r), 

ThU .pproxhatfen Is P.rtioulprt, good „ eS r the orSgF „ can be 
by multiplying the factor oontoining x by a number seller than one. The 
forn of this resu ] t shoes chat L[x) will have a cap at the origin for r 
greater than Or equal to one. 








NUMERICAL SOLUTION; 


It r& becoming increasingly obvious that art analytical solution is not 
around the corner, SO it is time to turn to numerical methods, Tihere are 
again various possible avenues, thE most obvious being Iteration since we 
already know some good First approximations we can speed up the convergence. 
The only difficulty is the singularity in the kernel for k * y « 0- Dividing 
the range of Integration evenly produces quite poor results particularly near 
the origin for large values of r. Dividing the range rare finely near the 
origin and ignoring the first few values near there is the obvious solution. 
Choosing as end-points of the intervals the points (i/n) works quite well, 
here n is the total number of Segments In the interval from 0 to 1* The 
mid-points of the intervals are used when evaluating the kernel. 

The resulting solutions for n = 25& were presented graphically earlier. 



